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TITLE: SYSTEM AND METHOD FOR ROBUST OPTIMIZATION INCLUDING UNCERTAINTY 
MODELS 



5 ' BACKGROUND OF THE INVENTION 

1. Field of the Invention 

The piesent invention relates to the field of optimization, particularly the application of optimization 
science in the realm of strategic decision-irialnng. 

10 

2. Description of the Related An 

Numerous approaches have been applied to the issue of strategic business decision-making, including 
decision support, data mining, and optimization. 

Decision support typically utilizes technologies such as On-Linc Analytical Processing fOLAP) and 

15 Relational On-Line Analytical Processing (ROLAP) to more systemically examine what has happened in the past 
With these approaches, a querying process may take place whereby a decision-maker may, for example, analyze all 
available data associated with transactions and customers, or a marketing manager may qucrv- a database to 
ascertain how well an offer performed with a customer segment over a period of time. These tools can be thought of 
as reporting applications. The decision-maker can create custom reports and can be alerted if a quer>' result falls out 

20 of a certain range. Performance can be measured and managed using these tools. Although it may be useful to look 
to the past before making decisions about the future, these tools arc often inadequate to he^ the decision-maker 
look into the future to the see the consequences of the numerous actions at his or her disposal. 

Anodier approach, data mining, may enable the decision-maker to look forward. Utilizing technologies 
such as neural networks and decision trees, data mining tools may be used to analyze large amounts of data and 

25 uncover patterns that lead to predictions of what future behavior a customer is likely to exhibit. The best tools in 
this category may be capable of identifying whom mariceters should target based on predicted responses. However, 
the proactive prescription of what to do to meet business goals is still beyond their capabilities. It is still up to the 
manager to determine what action to take. 

These aforementioned approaches may help decision-makers gain a better understanding of their 

30 customers, but it is still the manager who must use his or her experience and intuition to make the final decision of 
what to do. If managers are not careful, these tools may only push diem into making incorrea and -cosriy decisions. 
These toob may not use rigorous scientific approaches to determine at what point something should be done and, 
more inq>ortantly, what should not be done. Organizations relying solely on dicsc types of inadequate tools may 
siiapXy become more efficient at executing status quo decision-making strategies that have historically been 

35 followed 

Another approach, optimization, may address these problems at least in part Optimization may -combine 
intuition and intelligence in solving strategic decision-making problems. Unlike data mining, which starts with 
inputs and predicts an output, opnmization may start with the output and seek the best actions to take to^hange the 
output to the conq>any *s advantage. Data mining may tend to predict the future, but with optimkation, the decision- 
40 fwaVw may take actions to change die funne to the company's benefit. In many business environments, the^oal of 
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optiini2anon is to enable business decision-makere lo deiennine which combinations and levek of ncatmenis under 
their control should be applied. Typically, optinuzation solves a defined objective Huiciion, subject to one or more 
constraints, to select optimal values for one or more decision variables. Decision variables arc the parameters over 
which ihe decision-maker has control. For instance, in many business applications, net profit is to be maximized or. 
5 if the decisions being modeled do not impact revenues, total cost minimized. 

Typically, constraints are applied at the individual record level. These constraincs may be referred to as 
local, or record-level, consttaints. Cross-record constraints, on the other hand, may balance ^me resource or 
measurement across die entire set of records in the optimization simultaneously. Cross-record -constraints limit the 
allocation of a global resource over all the records, such as budgets, total cost, etc. Applying cross-record 

1 0 constraints to an optimization problem tends to be a much more difficult usk than applying local constraints, and so 
various heuristic techniques, such as the placement of Lagrangian muliipliers in the objective function, have been 
used. However, these approaches are inexact and only approximate the impact of cross-record ^nstraints. These 
techniques may also encounter significant problems if the number of cross-record constraints ^ws. -Kxact 
techniques of applying cross-record constraints are not believed to have been applied to customer relationship 

1 5 nuinagement or to the marketing of products to customers. 

Another approach that may be brought to bear in the optimization process is robust opiimizaiion. This 
technique may address the issue of uncenainty management by solving for the optimum solution over a variety of 
possible futures over the time frame of interest The uncenainties dealt with may originate from a number of 
sources, including environmental factors, such as the large-scale business climate, model«ctors, and input data^aps 

20 or errors. Hie goal of robust optimization is to fuid an optimal or near-optimal solution, which is not overly 
sensitive to any specific realization of the uncertainty of the problem. It is believed that the business application of 
this technique has been primarily in the area of fmancial invcsimcnl portfolio management and not to customer 
relationship management or the marketing of products to customers. 

Furthermore, optimization may be hampered by forecasting that ignores long-teim -considerations. In other 

25 words, current approaches may not adequately reflect behaviors that do not conq)lefely, directly, and empirically 
manifest themselves, for example, in a 6 or 1 2-month period. 

For at least the foregoing reasons, there is a need for an improved system and method for optimization 
which addresses the problems discussed above and which may be applied to the ar^a of customer relationship 
management 

30 

SUMMARY OF THE INVENTION 
The present invention provides various embodiments of a method and system for optimization of customer 
relationship management. Optimization may be used to select an optimal -course of action for marketing one or 
more products to a plurality of customers. Customers may include current customers or prospective^ustomers of a 
35 business. For example, customers may include credit customers to whom credit services axe marketed, or<:u5tomer5 
may include phannaceutical customers to whom pharmaceutical products are marketed. The one or more products 
may be madceted to customers in accordance with the optimal course of action, such as through direct mailing 
and/or targeted advertising. Other means of applying the optimal course of action may include, for example, 
conducting a re-pricing campaign in accordance with the optimal course of action, conducting an acquisition 
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campaign in accordance with the optimal couise of action, conducting an e-mailing campaign in accordance with 
the optimal course of action, and conducting a promotional campaign for crustomcr retention in accoixlance with the 
optimal course of action. As will be apparent to one skilled in the ait, the system and method for optimization 
described herein may be applied to a wide variety of industries and circumstances. 
5 An optimization process may accept the following elements as input: customer information records, 

predictive model(s) such as customer model(s), one or more constraints, and an objective. The optimization process 
may produce as output an optimized set of decision variables. 

Customers may include individual customers, s^ments of like customers, and/or samples of customers. 
The customer information may include decision variables and external variables. Decision variables are thcwe 

10 variables that the decision-maker may change to affect the outcome of the optiniization process. For example, in 
the optimization of a credit card offer conducted by a credit card issuer. Annual Percenuge Rate (APR) and credit 
limit may be decision variables. External variables are those variables that are not under the control of the decision- 
maker. For example, external variables may include variables such as customer addresses, customer income levels, 
customer demographic information, bureau data, transaction file data, cost of funds and capital, and other suitable 

1 5 variables. 

In one embodiment, the customer infotmation including decision variables and external variables may be 
input into the predictive model(s) to generate the action variables. In one embodiniem, the predictive nK)del(s) may 
be implemented as a neural network. The neural network may be trained, for example, with historical customer 
data records as input. In one embodiment, each of the predictive model(s) may correspond to one of the customer 

20 infnmation records. Action variables are those variables that predict a set of actions for an input set of decision and 
external variables. In other words, the action variables may comprise predictive metrics for customer behavior. 'For 
example, in the optimization of a product marketing campaign, the action variables may include the probability of a 
customer's response to an offer. In the optimization of a credit card offer, the action variables may include 
predictions of balance, attrition, charge-off, purchases, payments, and other suitable behaviors for the customer of a 

25 credit card issuer. 

In one embodiment, the objective function may be a fimction of lifetime customer value (LCV). The 
particular function which expresses lifetime customer value may vary 'from optimization process to optimization 
process. Generally, LCV may include a sum of discounted cash flows over the lifetime- of one or more customer 
relationships. The combination of the long-term view and short-term view may be implemented by the use of both 

30 constraint(s) and objective to embody the LCV. For example, one or more constraints may be used to ensure that 
the business maintains a particular level of revenue over the short term, while the objective may be used to ensure 
that the business maximizes the value of the customer relatiotiships over the long term. Likewise, the objective may 
include short-term considerations and the constraints may include long-term considerations. 

Constraints are typically "real- world*' limits on the decision variables. In one embodiment, the constraints 

35 include cross-record constraints. Cross-record constraints are limitations on one or more global resources as 
applied to a plurality of records. For example, a cross-record constraint may define a limitation on a quarterly 
budget or other finite resotirce that die optimization process is expected to meet. The constraints may also include 
one or more record-level constraints. A recoid-level constraint is a limitation that is applied to one record at a time. 
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For example, a record-level constraint may be a liniitation on an interest rate offered to a customer by a credit card 
issuer. In one embodinient, the optimization process may use a cross-record objective. 

In one embodiment, the optimization process may employ robust optimization. Solving the objective 
function for a robust optimization process may include solving the objective function across a plurality of 
5 uncertainty models to select the optimal solution. An uncertainty model may include any model which adds a range 
of uncertainty to an opiimization process. Unceitainty models may be generated by sampling a probability 
distribution. In one embodiment, the imcertainty modck may include scenarios. As used herein, ^scenarios** 
include multiple sets of possible values for uncertain data or models. For example, a robust optimization process 
may use scenarios to detemune an optimal solution across a range of possible models of a customer in the future. 

10 The scenarios may be designed so as to span the range of possibilities likely to occur over the time frame of interest. 

In one embodiment, a method for optimization of customer relationship management may include the 
following steps. A set of customer data and/or other data corresponding to one or more customers may be collected 
and received. Given the set of customer data, one or more decision variables may be optimized based on an 
objective and one or more constraints to produce optimized decision variables. The one or more terms of a product 

IS may be set to the optimized decision variables to pnxluce an optimized product. The optimized product may 
comprise a set of optimized terms. For example, if product is a credit card, then the optimized terms may include 
an optimal interest rate and credit limit. Generally, setting the decision variables of the product to the optimized 
decision variables may result in increasing the value of the product vendor's relationships with customers of the 
product. 

20 The optimized product may be offered to one or more of the customers. In various embodiments, the 

optimized product may be offered to cuuent and/or prospective customers in a variety of ways and under a variety 
of circumstances. For example, the optimized product may be offered via a direct mailing, targeted telephone 
advertising, a re-pricing campaign, e-mail, and/or a promotional campaign for customer retention. In appropriate 
cases, a response from the customer to the offering may be accepted. In variotis embodiments, the response may be 

25 accepted automatically and without human intervention, such as through an automated on-line or web-based 
system, or the response may be accepted with htm»n intervention. In some cases, such as changing the APR of a 
credit card, for example, receiving a customer response may not be pertinent. 

The optimized terms may be carried out during a lifetime of the optimized product. In other words, the 
product vendor may maintain the customer relationship for a particular product according to the optimized terms 

30 produced in the optimization process. Carrying out the optimized terms nuy include ^conducting one or more 
tzansactions acoordiqg to the optimized terais during the proditct lifetime. For «xan^>le, a credit card issuer may 
honor the interest rate and credit limit of the optimized offer for one or more credit-card transactions for as long as 
die customer holds the credit card. 

35 BRIEF DESCRIPTION OF THE DRAWINGS 

Figure 1 is an illustration of a typical computer system which is suitable for implementing various 
embodiments; 

Figure 2 is a network diagram of an illusurarive distributed computing environment which is suitable for 
inqilementing various enibodiments; 
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Figure 3a is a block diagram which illusoatcs an overview of optimization according U) one embodiment; 
Figure 3b is a dataflow diagram which illustrates an overview of optimization according to one 
embodiment; 

Figure 4 illustrates a single model according to one embodiment; 
5 Figure 5 illustrates multiple models for multiple products and a sii^le customer according to one 

embodiment; 

Figure 6 illustrates multiple models for multiple customers and a single product according to one 
embodiment; 

Figure 7a is a block diagram which illustrates an opdmization process widi cross-record constrainui or a 
1 0 cross-record objective according to one embodiment; 

Figure 7b is a dataflow diagram which illustrates an optimization process with cross-rccord consiraints or a 
cross-record objective according to one embodiment; 

Figures 8a through 8c illustrate examples of probability distributions associated with a robust optimization 
process according to one embodiment; 
1 5 Figure 9a is a block diagram which illustrates a robust optimization process according to one^nbodiment; 

Figure 9b is a dataflow diagram which illustrates a robust optimization process according to one 
embodiment; 

Figure 10 illustrates multiple scenario models for product-customer pairs according to one embodiment; 

Figure 11a is a block diagram which illustrates an optimization process wth an objecdve iimcnon of 
20 lifetime customer value (LCV) according to one embodiment; 

Figure 1 lb is a dataflow diagram which illustrates an optimization process with an objective lunction of 
lifetime customer value (LCV) according to one embodiment; 

Figure 12a is a block diagram which illustrates a robust optimization process with cross-record 
constraints/objective and an objective function of lifetime customer vahie (LCV) according to one enibodiment; 
25 Figure 12b is a dataflow diagram which illustrates a robust optimization process with cross-record 

constraims/objecdve and an objective function of lifetime customer value (LCV) according to one embodiment; 

Figure 13 is a flowchart which illustrates optimization of customer relationship management according to 
one embodiment; 

Figure 14 illustrates an off-line system architecmre for optimization of <:ustomar relationship management 
30 according to one embodiment; 

Figure 15 illustrates an impon module for optimizadon of customer reladonship management according to 

one ecnbodiment; 

Figure 16 iUusnates an export module for optimization of customer relationship management according to 
one embodiment; 

35 Figure 17 ilhistrates an design experiment module for optimization of customer relationship management 

according to one embodiment; 

Figure 18 illustrates an experiment engine module for optimization of customer relationship managennent 

according to one embodiment; 
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Figure 19 illustrates a build componencs module for opiimizatjon of customer relationship management 

according to one embodiment; 

Figure 20 ilhistrates an asscmble/senip components module for optimization of customer relationship 
management according to one embodiment; 
5 Figure 21 illustrates a manage questions sub-module for optimization of customer relationship 

management according to one embodiment; 

Figure 22 illustrates a manage optimization sub-module for optimization of customer relationship 
management according to one embodiment; 

Figure 23 illustrates a manage marginal optimization sub-module for optimization of customer relationship 
10 management according to one embodiment; 

Figure 24 illustrates a decision engine module for optimization of customer relationship management 
according to one embodiment; 

Figure 25 illustrates a decision views module for optimization of customer relationship management 
according to one embodiment; 

15 Figure 26 illustrates a decision reports module for optimization of customer relationship man^ement 

according to one embodiment; 

Figure 27 illusn-atcs an on-line experiment architecttire for optimization of customer relationship 
management according to one embodiment; 

Figure 28 illustrates an on-line decision architecmre for optimization of ^customer relationship man^emcnt 
20 according to one embodiment. 

While the invention is susceptible to various modifications and alternative forms» specific embodiments 
thereof are shown by way of example in the drawings and will herein be described in detail. It should be 
understood, however, that the drawings and detailed description thereto are not intended to limit the invention to the 
particular form disclosed, but on the contraty, the intention is to cover all modifications* equivalents, and 
25 alternatives falling within die spirit and scope of the present invention as defined by the appended-claims. 

DETAILED DESCRIPTION OF SEVERAL EMBODIMENTS 

Figtire 1 : A Typical Computer System 

30 Figure 1 illustrates a typical computer system 150 which is suitable for in^lenienting various 

embodiments. Each computer system 150 typically includes components such as a CPU 152 with an associated 
memory medium, represented by floppy disks 160. The memory medium may store program instmctions for 
con^utcr programs, wherein the program instructions are executable by the CPU 152. The computer system 150 
may further include a di^lay device such as a monitor 154, an alphanumeric input device such as a keyboard 156. 

35 and a directional input device such as a mouse 158. The computer system 150 is operable to execute the computer 
programs to implement an improved optimization system and method as described herein. 

The conqmter system 150 preferably inchidcs a memory meditmi on which computer programs according to 
various embodiments may be stored. The tenn "memory medium may include an installation medium, ^.g., a CD- 
ROM, or floppy disks 160, a conqiutcr system memory such as DRAM, SRAM, EDO RAM, Rambus RAM, cte^ or a 



6 



wo 01/55939 PCT/US01/028S0 
non-volatik mcmoiy such as a magnetic media, e.g., a hard drive, or optical stoiage. The memoiy medium may include 
other types of memory as well, or combinations thereof. In addition, the memory medium may be located in a first 
. computer in which the programs are executed, or may be located in a second difTerent computer which connects to the 
fust computer over a network. In the laner instance, the second cortqMitcr provides die program instructions to the first 
5 computer for execution. Also, the computer system 150 may take various forms, including! a personal computer system, 
mainframe computer system, workstation, network appliance, Imcmct appliance, personal digital assistant (PDA), 
television system or other device. In general, the term "computer system" can be broadly defuied to encompass any 
device having a processor which executes instructions from a memory mediunL 

Tlic memory medium preferably stores a software program or programs for event-triggered transaction 
10 processing as described herein. The software prograni(s) may be implemented in any of various ways, including 
procedure*based techniques, componenf-based technif]ues, and/or object-oriented techniques, among others. For 
example, die software program may be implemented using ActiveX controls. C^-+ objects, JavaBeans, Microsofl 
Foundation Classes (MFC), or odicr technologies or methodologies, as desired. A CPU, such as the host CPU 152, 
executing code and data from the memory medium inchides a means for creating and executing the software 
1 5 program or programs according to the methods and/or block diagrams described below. 

The computer system for optimization of customer relationship management as discussed herein may be a 
typical computer system 1 50 as illustrated in Figure 1 . 

Figure 2: A Distributed ComputinK Enviroiunent 

20 Figure 2 illustrates a distributed or enterprise computing envinmment according to one embodiment. A 

distributed computer system or enterprise 100 includes a plurality of computer systems which are interconnected 
through one or more networks. Although one particular embodiment is shown in Figure 2, the distributed ccHiqjuter 
system 100 may include a variety of heterogeneous computer systems and networks which are interconnected in a 
variety of ways and which run a variety of software applications and/or operating system software. 

25 One or more local area networks (LANs) 104 may be included in the enterprise 100. A LAN 104 is a 

network that spans a relatively small area. Typically, a LAN 104 is confined to a single building or group of 
buildings. Each node (i.e., individual computer system or device) on a LAN 104 preferably has its own CPU with 
which it executes programs, and each node is also able to access data and devices anywhere on the LAN 104. The 
LAN 104 thus allows many users to share devices (e.g., printers) as well as data stored on Tile servers. The LAN 

30 104 may be characterized by any of a variety of types of topology (i.e., the geometric arrangement of devices on the 
network), of protocols (i.e., the rules and encoding specifications for sending data, and whether the network uses a 
peer-to-peer or client/server architecture), and of media (e.g., twisted-pair wire, coaxial cables, fiber optic cables, 
radio waves). As illustrated in Figure 2, the distributed computer system 100 may include one LAN 104. However, 
in alternate configurations the distributed computer system 100 may include a plurality of LANs 104 which are 

35 coupled to one another through a wide area network (WAN) 102. A WAN 102 is a network that spans a relatively 
large geographical area. 

Each LAN 104 includes a plurality of interconnected computer systems and optionally one or more odier 
devices: for example, cme or more workstations 1 10a, one or more personal con^uters 1 12a, one or more laptop or 
notebook conqniter systems 1 14, one or more server computer systems 116, and one or more network printers 1 1 8. 
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As illusnated in Figure 2, an example LAN 104 may include one of each of computer systenns 1 10a, 1 12a, 114. and 
116, and one printer 118. The LAN 104 may be coupled to other computer systems and/or othei devices and/or 
other LANs 104 through a WAN 102. 

One or more mainframe computer systems 120 may be coupled to the distributed computer system lOO. 
5 As shown in Figure 2, the mainfiamc 120 may be coupled to the distributed con^utcr system 1 00 through the WAN 
102. but alternatively one or more mainiramcs 120 may be coupled to the distributed computer system 100 through 
one or more LANs 104. As shown, the mainframe 120 may be coupled to a storage device or file senrer 124 and 
mainframe terminals 122a, 122b, and 122c. The mainframe terminals 122a. 122b, and 122c may access data stored 
in the storage device or file server 124 coupled to or included in the mainframe computer system 120. 

10 The distributed computer system 100 may also include one or more computer systems which are connected 

to the distributed computer system 100 through the WAN 102: as illustrated, a workstation I lOb and a personal 
computer 1 12b. In other wortis. the enteiprise 100 may optionally include one or more computer systems which arc 
not coupled to the distributed computer system 100 through a LAN 104. For example, the distributed computer 
system 100 may include computer systems which are geographically remote and connected to the disoributed 

1 S computer system 1 00 through the Internet. 

Figures 3 through 6: Overview of Optimization 

As discussed herein, optimization may generally be used by a decision-maker associated widi a business to 
select an qptimal course of action or optimal course of decision. The optimal -course of action or decision may include a 

20 sequence or combination or actios and/or decisions. For example, optinnization may be used to selea an optimal 
course of action for marketing one or more products to one or more customers. As used herein, a "customer" ntiay 
include an existing customer or a prospective customer of the business. As used herein, a "customer" may include one 
or more persons, one or more organizadons, or one or nnore business endues. As used herein, the term ^'product** is 
intended to include various lypes of goods or services, such as books, music, content subscription services, furniture, 

25 online auction items, clothing. ISP service, consumer electronics, travel, software, phaimaoeutical or medical suppties, 
computer systems, etc., or various services such as loans (e.g., credit card, auto, mortgage, and home re-tinancing loans), 
' securities (e.g., CDs, retirement accounts, cash management accoimts, and mutual funds), or insurance (e.g., life, health, 
auto, and home owner's insurance), among others. For exantple, customers may inchide <Tedii cusionriers to vdiom 
credit services are marketed, or customers may include pharmaceutical customers to whom pharmaceutical products are 

30 marketed. As will be apparent to one skiDed in the art* the system and n:iediod for optiinizadon den 
applied to a wide variety of industries and circumstances. 

Generally, a business may desire to apply the optimal course of action or optimal course of decision to one 
or more customer relationships to increase the value of customer relationships to the business. As used herein, a 
••portfolio" includes a set of relationships between the business and a plurality of customers. In general, the process 

3S of optimization may include determining which variables in a particular problem axe most predictive of a desired 
outcome, and what treatments, acdons, or mix of variables under the decision-maker's contiol (i.e., decision 
variables) will optimize the specified value. The one or more products may be marketed to customers in accordance 
with the optimal course of action, such as through direct mailing and/or targeted advertising. Other means of 
applying die optimal course of action may include, for example, conducting a re-pricing campaign in accordance 
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with the optimal course of action, conducting an acquisition campaign in accordance with the optimal course of 
action, conducting an e-mailing campaign in accordance with the optimal course of action, and conducting a 
promotional campaign in accordance with the optimal course of action. 

Figure 3a is a block diagram which illustrates an overview of optimization according to one embodiment. 
5 Figure 3b is a dataflow diagram which illustrates an ovcrx'iew of optimization according to one embodiment. As 
shown in Figure 3a, an optimization process 200 may accept the following elements as input: customer information 
records 202, predictive model(s) such as customer modcl(s) 204, one or more constraints -206, and an objective 208. 
The optimization process 200 may produce as output an optimized set of decision variables 210. In one 
enibodinient, each of the customer model(s) 204 may correspond to one of the customer information records 202. 

1 0 As used herein, an ''objective** may include a goal or desired outcome of an optimization process. 

As used herein, a "constraint" may include a limitation on the outcome of an optimization process. 
Constraints arc typically **reaI-world** limits on the decision variables and are often critical to the feasibilit>- of any 
optimization solution. Managers who control resources and capital or arc responsible for fuancial effects should be 
involved in setting constraints that accurately represent their real-world environments. Setting constraints with 

1 S management input may realistically restrict the allowable values for the decision variables. 

In many applications of the optimization process 200, the number of customers involved in the 
optimization process 200 may be so large that treating the customers individually is computationally unfeasible. In 
these cases, it may be useful to group like customers together in segments. If segmented properly, the customers 
belonging to a given segment will typically have approximately the same response in the action variables to a given 

20 change in decision variables and external variables. For example, customers may be placed into pantcular segments 
based on particular customer attributes such as risk level, fmancial status, or other demographic information. Each 
customer segment iruy be thought of as an average customer for a pardcular type or profile. A segment model, 
which represents a segment of customers, may be used as described above with reference to a customer model 204 
to generate the action variables for that segment. Another alternative to treating ciistomers individually is to sample 

25 a larger pool of customers. Therefore, as used herein, a "customer** may include an individual customer, a segment 
of like customers, and/or a sample of customers. As used herein, a "customer model'*, .'"predictive moder, or 
"model** may include segment models, models for individual customers, and/or modeb used with samples of 
customers. 

The customer information 202 may include decision variables 214 and external variables 212. As used 
30 herein, ''decision variables'* arc those variables that the decision-maker may change to affect the outcome of die 
optimization process 200. For example, in ^e optinuzation of a credit card offer conducted by a credit card issuer. 
Annual Percentage Rate (APR) and credit limit may be decision variables. As used herein, "external variables** are 
those variables that arc not tmder the control of the decision-maker. In other words, the external variables are not 
changed in the decision process but rather are taken as givens. For example, external variables may iiichide 
35 variables such as customer addresses, customer income levels, customer demographic information, bureau data, 
transaction file data, cost of funds and capital, and other suitable variables. 

In one embodiment, the customer information 202 including decision variables 214 and external variables 
212 may be input into die predictive models) 216 to generate the action variables 218. In one embodiment.>«ach 
of the predictive nuMlel(s) 216 may coirespond to one of the customer information records 202, wherein each of the 
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customer informatioD records 202 may include appropriate decision variables 214 and .external variables 212. As 
used herein, "action variables'* are those variables that predict a sel of actions for an input set of decision and 
external variables. In other words, the action variables may comprise predictive metrics for customer behavior. For 
example, in the optimization of a product marketing campaign, the action variables may include the probability oTa 
5 customer's response to an offer. In a re-pricing campaign, the action variables may include the likelihood of a 
customer maintaining a service after re-pricing the service. In the optimization of a credit card offer, the action 
variables may include predictions of balance, attrition, charge-ofT, purchases, payments, and oflicr suitable 
behaviors for the customer of a credit card issuer. 

The predictive modet(s) 216 may include the customer model(s) 204 as well as other models. The 
10 prediciive model(s) 216 may lake any of several forms, including, but not limited to: trained neural nets, statistical 
models, analytic models, and any other suitable models for generating predictive metrics. The models may take 
various forms including linear or non-linear, such as a neural network, and may be derived from empirical data or 
from managerial judgment. 

In one embodiment, the predictive model(s) 216 may be implemented as a neural network. Typically, the 
1 5 neural network may include a layer of input nodes, interconnected to a layer of hidden nodes, which arc in turn 
interconnected to a layer of output nodes, wherein each connection is associated with an adjustable weight whose 
value is set in the training phase of the model. The neural network may be trained, for example, with historical 
. customer data records as input. The trained network may include a non-linear mapping function that may be used 
to model customer behaviors and provide predictive customer models in the optimization system. The trabed 
20 neural network may generate action variables 218 based on customer information 202 such as external variables 
212 and decision variables 214. 

In one embodiment, a model comprises a representation that allows prediction of action variables, a, due to 
various decision variables, d, and external variables, e. Figure 4 illustiates a model 215 with external variables 212, 
decision variables 214, and resulting action variables 218. For example, a eustomer may be modeled to predict 
25 customer response to various offers under various circumstances. It may be said that the action variables, o, are a 
function, via the model, of the decision and external variables, d and e, such ttiat: 

wherein A/() is the model, a, is the vector of action variables, d is the vector of decision variables, and e is the vector 

30 of external variables. 

In one embodiment, the action variables 218 generated by the model(s) 216 may be used to formulate 
constraixit(s) 206 and the objective function 208 via fommlas. In Figure 3b. a data calculator 220 generates the 
consvaint(5) and objective 222 using the action variables 218 and potentially other data and variables. In one 
embodiment the formulas used to formulate the constraint(s) and objective 222 may inchide fmancial formulas 

35 such as formulas for determining net operating income over a certain time period. The consiraint(s) and objective 
222 may be input into an optimizer 224, which may comprise, for example, a custom-designed process or a 
commercially available "off the sheir prtMluct. The optimizer may then generate the optimal decision variables 210 
which have values optimized for Che goal ^ecified by the objective function 208 and subject to the constraini(s) 
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206. The optimization process 200 cairicd out by the optimizer 224 is discussed in greater detail below. A further 
understanding of the optimization process 200 may be gained from the references ^^An Introduction to Management 
Science: Quantitative Approaches to Decision Making", by David R. Anderson, Dennis J. Sweeney, and Thomas 
A. Williams. West Publishing Co. (1991); and "Fundamentals of Management Science" by Efraim Turban and Jack 
R. Meredith, Business Publications, Inc. ( 1 988). 

Overview of Optimization for a Single Customer 

Many optimization problems have the following form: given a model of a customer or segment 

a = A/(rf,e). a set of objective parameters o, a set of constraint parameters and a set of constraint bounds 
use an optimizer to compute the set of decision variables for a customer or segment that extremizes (e^.. maximizes 
or minimizes) an objective function of the form: 

J = f{d,e,a.o) 

subject to the model constraint: 

a = M{d,e) 
and a general set of constraints of the form: 

0<g(c/,e,a,cj<c, 

wherein the decision variables d, are a subset of the set of possible decision variables, C 

There arc a number of approaches for solving optimization problems of this fonm. As is well known by 
those skilled in the art, the approach selected depends on the form of the models of the objective function, of the 
constraints, and of the set of possible decision variables. The model, objective function, and<:onstraints may each 
be either linear (L) or non-linear (NL). The decision variable set, Z). may be a linearly bounded single region 
(simple convex area) (L), a non-linear bounded single region (NL), multiple regions (MR), or discrete. Commercial 
solvers, or optimizeis, are available for solving all combinations of linear and non-linear components for single 
region decision variable sets. For the cases when variables are not restricted to a single -continuous region, a variety 
of other, more heuristic, approaches are generaUy available. Several of these approaches solving optimization 
problems ate discussed in greater detail as follows. 

Example of Optimization with Linear Programming 

A simple credit card offer optimization problem illustrates the LP approach. The model computes the 
re^KMise late to a mailed offer and expected monthly balance of a responder; therefore, the action variables arc: a, 
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= response rate; « expected balance. The decision variables tor the offer arc annual pCFcentage rate (APR) and 
credit limit; thus, </; APR; d: » credit limit. There are no external v'ariables in this example. 

A linear model of the form: 

5 

a, = + Wijrfj +6, 

may be used, wherein iV|/. iv/*. 6|, w^/, ivj.s and At arc parameters of the model. The parameters may be^found, for 
example, using linear regression techniques based upon historical data. 

1 0 The objective function, J, to be maximized, also linear, is of the form: 

wherein O/ is an optimiTation parameter. Using this objective function, ai and cj may be maximized. The relative 
importance of ai versus a2 is determined by the optimization pararheter, O/, which is specified by the user. 
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A linear constraint is of the form: 
and the set of possible decision variables, D, is restricted such that: 



(6) 



.05 <d, ^.\9 ^^^^ of APR) (7) 

1,000 <d .< 5,000 ^'^"ec of credit limit) (8) 



Because the model, objective function, constraint, and set of decision variables axe linear, this example can 
be solved using standard linear programming techniques. 

25 Example of Optimization with Non-Linear PrograraminR 

In a further example, the objective, constraints, and set of decision variables arc of the form shown above, 
and tfie model is implemented by a non*linear neimil network: 

a = M{d,e) = AW(rf,e, w) W 
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whciein w is the vcclor of weight paramctcis of the neural network which may be identified using historical data 
and the back propagation method of neural network training, in this case, because the model is non-linear, a non- 
linear commercial solver/opdmizer may be used to solve for the decision variables. 

Overview of Optimization with Heuristic Linear Programming 

A similar problem may be considered, but with the set of possible decision variables restricted to a discrete 

set, such as: 



[d, ] ^ ([lOOo]|lOOo]{250o]{500o]] 



(10) 



such that ihc APR values of each of the four offers are 5%. 9%, 1 2.5%. and 1 9%, respecrively, and the credit linuts 
ate $1000, SIOOO, $2500, and $5000. respecrively. Because the problem is non-linear and discrete, a mixed integer 
hnear programming (MILP) approach may be used; however, by reformulating the problem heuristically. a linear 
programming (LP) technique may be used instead. This is referred to as a heuristic LP approach. 

The above problem may be refomuilated by enumerating the solutions.-««., by computii^ the output of 
the neural network model for each element of the set: 

r 1 

r' e (AW(.05,1000).AW(.09,1000).AW(.125,2500), AW(.19.5000))= 

{[:::]{:«:]) 

wherein Ihc output corresponding to the first element of the set j * ^ objective function, 7, may then be 

rewritten to select the optimal pair of action variables: 

max J =W,(0,fl„ +^21)+ "2(^2^12 -^«22)+"3{^l'»l3 +fl2j)+'»4(<>4«l4 +«24) ^^^^ 

wherein are selection variables constrained by: 

0£n,<l 
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(14) 



and wherein: 

5 At this point, a conventional linear programming technique may be used because ihe selection variables 

are optimized, rather tfian the decision variables, and because «; appear linearly. Once the optimal selection 
variables are computed, one of the fi. will be equal to 1, with the rest equal to 0, assuming only one maximum in 
the set. The optimal decision variables of the set correspond to the n. equal to I. Thus, the decision variables are 
computed using a heuristic LP approach. This technique may generally be used when the set of discrete decision 
10 variables is finite. 

Overview of Optimization for Multiple Products or Multiple Customers 

In the cases where multiple products may be offered to a single customer, or where a single product may 
be offered to multiple customers, a different model may be used for each product/customer pair. For example, in 
15 the case of a single customer being offered multiple products, the models may be defmed as follow^: 

with a set of Boolean selection variables: 

(16) 



20 



^ ~ (^I >'^2 ♦•••^■t ) 

that may be used to select which offers lomakc to the customer. Figure 5 illustrates the muMple product models of 
expression (15). 

In a similar way, for die case of a single product being offered to multiple customen, the models may be 
25 defmed as follows: 
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/ \ -(18) 

Figuie 6 illustrates these multiple customcT models. Optimization with multiple customer models is mathcmatically 
equivalent to optimization with multiple product models. 

Given the above set of models for various products M e {M ^yM M ^) for a customer (i.e., an 
individual customer, customer segment, or cusiomer sample), a set of objective parameters o, a set of constraint 
parameters a set of constraint bounds cih and an objective function of the form: 



which is subject to the model constraints: 

and a general set of constraints of the fomi: 

0<g{d^,e^,a^,5^,d^,e^,a^,s^,..d„,e^,a^,s„,c^)<Cf, 
and ihe set of possible decision variables, A and selection variables, 5, such that: 

d^D 
seS 



(19) 



(15) 



(20) 



(21) 



then an optimizer may generally be used to compute the decUion variables for a -customer to extremize the objective 
Junction, 7. 

Figure 7: Optimization with Ooss^Record Constraints 

Figure 7a is a block diagram which illustrates an optimization process 200 with cross-record constraints 
according to one embodiment. Figure 7b is a dataflow diagram which illustrates an optimization process 200 with 
cross-record constraints according to one embodiment, in one embodiment, the constraint(5) 252 may inchide one 
or more cioss-iccord constraint(s), and the optimizer 224 nwy solve the objective 208 subject to the cross-record 
constraint(s) 252. As used herein, a "cross-record consnaint" is a limitation on one or more global resources as 
applied to a plurality of records such as customer information records 202. For example, a cross-record constraint 
may define a limitation on a quarterly budget or other finite resource that the optimization process 200 is expected 
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to meet. The constraint(s) 252 may also include one or more record-level constraints. As used herein, a "record- 
level constraint" is a limitation that is applied to one record at a time. For example, a record-level constraint may be 
a limitation on an interest rate ofTered to a customer by a credit card issuer. 

The optimizaiion process 200 may also be solved subject to limitations on global resources by using a 
cross-record objective ftinciion 209. Therefore, the data calculator 220 may generate cross-record consirainKs) 
and/or cross-record objective 254 for use by the optimizer 224, An objective function is a cross-record objective 
(unction if it cannot be written as a sum of individual record objectives: 

J = /(</, , e, . fl, , J, .^2 » ^2 » -^m ^^m^^m 

An example of such an objective might be the profit for a collection of product offers. 

Figures 8 through 10: Robust Optimization 

Figure 9a is a block diagram which illustrates a robust optimization process according to one -embodiment. 
Figure 9b is a dataflow diagram which illustrates a robust optimization process according to one embodiment. 
Generally, robust optimizaiion includes constrained optimization across a plurality of uncertainty models 260. In 
other words, solving the objective function in robust optimization may include solving the objective function across 
a plurality of uncertainty models 260 to select the optimal solution, given the uncertainty provided by the 
uncertainty modeU 260. As used herein, an "uncertainty moder may include any model which adds a range of 
uncertainty to an optimization process. "Robust optimization" is generally synonymous with stochastic or 
probabilistic robust optimization. 

In a deterministic model, a change in decision variables or external variables results in exactly (i.e.. 
detcrministically) the same change in the resulting action variables. Thus, a deterministic model /l.) may be 
expressed as follows: 



(23) 



In a nondetemiinistic or uncertainty model, a change in decision variables or external variables may not 
result in exactly the same change in die resulting action variables. In this case, die action variables may be 
represented by a probability distribution: 



piji\d,e) 



(24) 



The model (24) is the probability distribution of the action variables, a, given the decision and external variables, d 
and In a preferred embodiment, robust optimization uses a nondetenninistic or uncertainty model for a 
customer/segment, as shown in expression (24), rather dian a deterministic model. 
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In many cases, the direct ptxibability disoiburion cannot be used in the qitimizaiion pioblem. «iiher 
because the distribution cannot be computed in a reasonable time or the optimization pr^lem cannot be computed 
in a leasonable time. In these cases, samples of the distribution may be used to solve or approximate the solution to 
the problem. Samplii^ is iUustraied by the following simple problem. The expected value of a disffibution.y;x), 
can be approximated by drawing N random samples from/^x). Thus: 



(25) 



wherein are the independent samples of J[xy The independent samples are known as soeiiarios. By 
independently sampling the probability distribution p(a\d^e)^ a set of scenario modeb 
{a, = f,{d*e\a^ = /jCrf.eXIC = A W.^)} may be generated. The scenario models may then be used 
to approximate the robust optimization solution. The solution may be determined as shown above for multiple 
models. 

Bayes* Rule allows us to express the probability distribution (24) as: 
p{a\d.e)^p{d,^a)p^{a) 



wherein pffji) is known as the prior distribution and is normalized. By assuming a prior distribution, p(d) , the 
probability distribution may be approximated as: 

p{a\d,e)^p{d,^a)p(a) ^^^^ 



In general, it is easier to sample pid.^a) than p{a\d,€) . Thus, sampling of /K</,e|a) may be used 
in many cases. Sampling models and optimization approaches using this technique are further discussed in a patent 
application entitled ^'Bayesian Neural Network for Optimization'* by E. Harmian and C Petetson. S/N 09/290J91, 
filed 4/12/99, which is incorporated herein by reference, as though tuUy and completely set forth herein. 

A second approach to san^ling the distribution, p{ja\d^€) , is realized by: 
p(ajt/.e) = /„i(d.e) + p(r|rf.e) 
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wherein fj^ye^d^e) is a detcrmuiistic function representing the average of the distribution, p(a|c/,-e). and 
wherein pKr\d^e) is the residual distribution. In this case, the residual distribution is sampled rather than the 
actual distribution. 



It is conunon to train a neural network to represent (rf, . Thus: 

Furthemiorc, it may be assumed that pir\d^e) is independent of </. e. Thus: 

/>(r|rf,e) = /»(r) 



(29) 



(30) 



and 



/,(a|</,«)sAW^„(</,e) + /'('■) 



(31) 



Given an historical daoset, D, the tWAVt can be developed. Hie historical daiasel can also be used to 
deteimine the distribution of die residuals. In diis case, die distribution is dependent on the historical data, and dius: 

is the distribution. This results in the model: 

S m^y^{d,e)^p(r\U) ^^^^ 



One form of the distribution for p(40) is a normal distribution witfi zero mean //(or|D) , as iUustratcd 
in Figure 8a. and wherein c is the standard deviation. <3ivcn the residuals, for the historical dataset A ihc standard 
deviation may be computed, giving the model: 

p{a\d,e) = NN^yrXd.e) + N{op) ^'^^^ 



It is straightforward to sample this distribution and create scenario modeb. 
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Another distribution is the symmetric triangle distriburion 7lw) shown in Tigurc 8b, wherein *v is the 
width. The residual data may be used to detennine w for (he distribution: 



(35) 



S The distriburions may be sampled yielding models of the form: 

M ^^^^ 
a,^^=NN^y^(d,e)'hr^ 

wherein ri, rj. . . are samples of p(r\D) . 

10 Because events of the ftinire may differ from the past, the user may override die historical data and use his 

or her best juc^ment to select an appropriate distriburion. Robust optimization may therefore be enhanced by 
management judgment. For example, consider the triangle distribution expressed as distribtition (35), or by 
applying Bayes* Rule: 



IS 



p(fl|rf.e) s NN^^id^e) + nD\W)Tiw) ^^^^ 



The user may select an appropriate prior distribution for 7(w). Often, a broad tjaussian distriburion may 
be selected, as shown in Figure 8c. However, the user nmy feel that the world is too uncertain to trust the historical 
data as a guide to future events. Therefore, the user can select a prior distriburion with a high value for w to 
represent a region of higher uncertainty, as shown in Figure 8d. The user may also select the distriburion shown in 
20 Figure 8e, resuhing in the following model: 



p(a\d,e) s NN^yAd,e) + riJV) 



(38) 



By setting the prior distriburion in this way, management judgment can be taken into account in the 
probability models and thus in robust optimization. 
25 In one embodiment, the uncertainty models 260 may include sceiuuios as discussed above. As used 

herein, **sccnarios- iiKlude mulriple sets of possible values for uncertain data. Scenarios may express a range of 
uncertainty in the future. The scenarios may be designed so as to span the range of possibiiiiies likely to occur over 
the time frame of interest. In this way, the decision-maker may measure the consequeiKes of environmental 
uncertainty, model enors, gaps or errors in input data, or errors experienced in predicted and forecasted behaviors 
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or other business parameters that impact his or her decision meiric, and in doing so, determine his or her strategy 
based upon the desired level of risk. 

As shown in Figure 10, multiple scenarios may be represented by multipie models for a product- 
customer/segment pair: 

5 

fl, =A/(rf,,e,),fl2=A/(rfj,C2) flp-A/(rf^,eJ 

The notation is similar to that for multiple products/customers as discussed with refcfcnce to Figures 5 and 6,«xcept 
that instead of Boolean selection variables, weights may be used to weight the impoitancc or likelihood of one 
model against another. A probability may be assigned to each scenario to denote its likelihood of occutience. 
10 These probabilities may be used to weight the contributions of each record's consirainl and objective calculations, 
therefore allowing the decision-maker to assess the consequences of strategic decisions in the light of the relative 
associated risks. 

In one embodiment, the plurality of uncertainty models 260 may be generated by varying a set of action 
variables 218 to represent varying circumstances of possible futures. Uncertainty models may be used to vary the 

1 5 values of the action variables 21 8 according to ( I ) some set of empirical distributions tone or more distributions per 
action variable) or to (2) some set of distributions derived through managerial judgment or to (3) some combination 
of empirically derived and judgmenially derived distributions. The objective function may be a function of the 
action variables 218 across a plurality of uncertainty models ^260. 

In another eihbodimcnt, probabilities are not assigned to die scenarios; rather, a decision table may be 

20 used in conjunction with any of a number of well-established methods, such as Equally LikelyCriterion. Maximax 
Criterion, Maximin Oitcrion, Hurwicz Criterion of Realism, or Minimax Regret, as wiU be familiar to diose skilled 
in the art. A greater understanding of these established mediods may be gained by referring to an elementary text 
on Management Science or Decision Analysis such as "Spreadsheet Modeling and Decision Analysis: A Practical 
Introduction to Management Science". Oiff T. Ragsdale, Course Technology Inc. (1997). 

25 

Figure 1 1 : Optimization of Lifetime Customer Vahie 

In the past, businesses typically focused their predictive modeling and even their optimization on the near 

term. Short-teim considerations, such as Net Operating Income (NOI) or quarteriy profitability, are often useful; 

however, it may be even more useful to enable decision-makers to project much turther into die future, so that 
30 behaviors that do not completely manifest in a 6 or 12-mondi period may still be fully considered in the 

optimization process 200. Long-term forecasting may enable the manager to make decisions with a strategic focus. 

Integrated modeling and forecasting may enable die manager to balance short-term and long-term concerns to 

determine which decisions provide the most value to the business. 

Figure 1 la is a block diagram which illustrates an optimization process 200 widi an objective liinction of 
35 lifetime customer value (LCV) according to one embodiment. Figure 1 lb is a dataflow diagram which illustrates an 

optimizatioii process 200 with an objective function of lifetime customer value according to one embodiment As 

discussed above, the mediod and system for optimization may be applied to select an optimal course of action for 

mariceting products to the plurality of customers. In one embodiment, the objective function 230 may include 
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considcraiions of lifcrime customer value. In other words, the objective funcrion may be a funcUon of LCV. In one 
embodiment, the LCV may be implemented through the use of constraints 235 in addition to the use of the objective 
function. 

The panicular function which expresses lifetime customer value may vary from c^timiraiion process to 
optimization process. For example, LCV may be calculated differenUy for a particular credit card offer 
optimization than for a particular pharmaceutical offer oprimizadon. Generally, LCV may include a sum of 
discounted cash flows over time. In one embodiment, in other words, the basic form of LCV is as follows: 



_ Y (Net Income After Tax_t) 
"" V (1 + Discount Rate)' 



(40) 



10 wherein Net Income After Tax J (NL\T) is a difference of cash inflows and cash outflows for a time period 'V. 
Cash inflows for time period *T may include, for example, sales income, fee income, and interest income. Cash 
ouHows for a time period "i" may include, for exaniple, chargc-ofT expense, cost of funds, and markenng<ost. Net 
Income After TaxJ is therefore discounted and sununed over the entire post-neaiment period. In this way, the 
value that each customer in the portfolio will provide to the organization over the lifetime of the relationship may be 

15 found. 

LCV may include a long-term view and a short-term view of the customer relationship($). As used herein, 
a "long-term view" includes a period of one or more years. The combination of the long-tenn view and short-term 
view may be implemented by die use of bodi constraint(5) and objective to embody the LCV. Forexattqsle, one or 
more constraints may be used to ensure that die business maintains a panicular level of revenue over the short term, 

20 while the objective may be used to ensure that the business maximizes die value of the customer relationships over 
die long term. Likewise, the objective may include short-term considerations and the constraints may include long- 
term considerations. Various combinations of die objective, constraints, short-temi considerations, and long-term 
consideraUons may be used to arrive at an appropriate LCV function for a particular optunization process^OO. 

In one embodiment, as shown in Figure 1 lb, the action variables 219 over the lifetime of die retadonship 

25 may be received as input to a data calculator such as a cash flow calculator 232. Ihe cash flow calculator -232 may 
include a set of financial formulas dial arc used to calculate die constraint fiinctionts) and the objective ftmction 
including LCV 234 for each input data set of die external variables 212 and decision variables 214. In one 
embodiment, die cash flow calculator 232 may calculate a series of per-customer LCV values c^* for a .given 
segment i, offer 7, and scenario 5, where die per-customer LCV is a function of die action variables for a given 

30 customer/segment 1, offer 7, and scenario s: 

c,'^LCV(ag') 

The cash flow calculator 232 may measure all die cash inflows and outflows required by the objective 
function and constraints 234, The cash flow calculator 232 may calculate inflows and outflows from model 
35 predicdons and forecasts of account behavior as well as from odier data available to die decision-maker. In doing 
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so, the cash flow calculator 232 may conven available data into a series of detailed and customizable cash flows at 
particular time intervals (e.g., monthly, quanerly, bi-annually or annually). Cash inflows and outflows may also 
facilitate the calculation of "nerminal value." Individual cash flows may be calculated at the mosi granular or 
detailed level witfi respect to the difl*erent individual components that comprise all flows of cash. Individual cash 
5 flows may be discounted and may uldmately form the LCV expression that is the objective function 230 of the 
optimization analysis. 

Fit^ure 12: Robust Optimization of Lifetime Customer Value with Cross-Record Constraints and/or Cross-Record 
Objective 

10 Figure 12a is a block diagram which illustrates a robust optimization problem with cross-record constraints 

and an objective function of lifetime customer value (LCV) according to one embodiment. Figure 1 2b is a daUflow 
diagram which illustrates a robust optimization problem with cross-record constraints and an objective function of 
lifetime customer value (LCV) according to one embodiment. In other words, the approaches discussed with 
reference to Figures 3 through 1 1 may be practiced together according to one embodiment. 

15 As shown in Figure 12a. an optimization process 200 may accept the following elements as input: 

customer information records 202, customer model(s) 204, uncertainty modei(s) 260, one or more consnaints 271. 
and an objective 231. The constraint(s) 271 and/or objective 231 may include LCV. The consnaints 271 and/or 
objective 231 may be cross-record. The optimization process 200 may produce as output an optimized set of 
decision variables 210. 

20 As ^ovm in Figure 12b, the customer information 202 including decision variables 214 and external 

variables 212 may be input into the predictive model(s) 216 to generate the action variables 219 over the lifetime of 
the customer relationship. The predictive model(s) 216 may include the customer modeKs) 204 and uncertainty 
model(s) 262, A data calculator such as a cash flow calculator 232 may include a set of fmancial formulas that are 
used to calculate the constraint fiinction(s) and the objective function including LCV and cross-record constraints 

25 and/or cross-record objective 270. An optimizer 210 may then produce an optimized set of decision variables 210 
which may be applied by the business to increase the value of customer relationships. 

In the case of multiple customers with multiple products across nuiltiple scenarios, a large number of 
models may be required. This population of models may be thought of as forming a cube of models^ with the three 
axes representing customers/segments, products, and scenarios, respectively. For example, for a problem with 10 

30 customefs/segments, 10 products, and 20 scenarios, 2,000 models may be required. The form of the optimization 
for these problems is also generally the same as that for multiple ctistomers/produccs. Therefore, in one 
embodiment, the multiple models may be included in the objective and constraints. Depending on the flnal form of 
the objective and constraints, the appropriate optimization technique may be selected, as discussed with reference to 
Figures 3 through 6. 

35 

Example 1: Linear Programming Formulation without Scenario Probabilities 

An example of robust optimization (RO) of LCV with a cross-record constraint of Net Operating ^ome 
(KOI) is given as follows. In expressions (42) through (44), d are decision variables, are decision variables for 
segment i given oflcr j under scenario 5, e are external variables, e^' are external variables for segment i given offer 
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j under scenario a are acrion variables, a/ arc action variables for segment i given offcry under scenario ^, o arc 
objective parameters (such as penalty weights or objective coelTtcients), is the number of customers (i.e., current 
customets or prospective customers) in segment i who get offery, c,/ is LCV per customer for segment / given offer 
j under scenario s, N^* is NOl per customer in segment i given offer y under scenario 5, A^, is an NOI requirement for 
time period f, and A^/ is the admissibility of offer j in segment / under scenario s (Aj - \ if admissible; « 0 

otherwise). As discussed with reference to Figure 6, cj = LCV{a^' ) , This fonmulation has multiple scenarios 
such that one of the RO decision criteria discussed above could be applied to fmd the RO solution: 

max/ = f(d.e.a.o) = ^X^^ir-^^ foralU ^^^^ 

i J ■ 

such that 5] Z ^^''e^^ ^ ^- ' ^^^^ 



This is a typical constraint which shows that in each scenario s and in each rime period r, the total amount 
of near-term revenue (expressed here as Net Operating Income) must exceed' some threshold value A similar 
constraint could keep losses below a given threshold. In fact, almost any resource may be constrained. 

This formulation may be converted into a Linear Program (LP) by introducing the scalar variable y. In the 
1 5 formulation shown as expression (44), each scenario above becomes one constraint, and the variable y t>ecomes the 
objective value of the LP. This LP gives the Maximin RO solution. The scenarios do not have probabilities. 



max over 



y such that XS^J^y^r^ for alls 
' J 

ZZ^M^^' foraUs,t 



(44) 



Example 2: Linear Programming Formtilation with Scenario Probabilities 

20 An example of robust optimization (RO) of LCV with "soft" cross-record constraints of minimum Net 

Operating Income (NOI) and maximum first-year loss, using slack variables, is given as follows. In expressions 
(45) through (49), p, is the probability that scenario j occurs. E{.) is mathematical expectation (i.e., expected value), 
wik is a weighting factor for constraint A, ni// is negative deviation in scenario 5 from meeting constraint A, m/* is the 
negative deviation across all scenarios, pdk is positive deviation in scenario s from meeting constraint k, d m 

25 decision variables, df,' arc decision variables for segment i ^iven offer j under scenario 5, e are external variables, e^' 
are external variables for segment r given offer J under scenario 5. a are action variables, a^* are action variables for 
segment i given offer j under scenario 5, o arc objective parameters (such as penalty weights or objective 
coefficients), is the number of customers (i.e.. current customers or prospective customers) in segment i who»get 
offer j. Hi is the number of accounts represented by record i (i.e., in that micros^ment), is LCV per customer for 

30 segment i given offer j under scenario 5, is NOI per customer in segment i given offery under scenario $, is 
NOI requirement number k^i^ 'v& first-year losses per customer in segment i* given ofTery under scenario 5, Lk is 
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fust-year loss requirement number k, A^/ is the admissibility of offer y in segment i under scenario s {A^* « 1 if 
admissible; A-f - 0 otheiwisc), and is the admissibility of offcrj in segment i under all scenarios. As discussed 
widi reference to Figure 6. C^/ = LCV{aj/). In this example, the LP formulation for maximizing the expecied 
value of LCV is as follows: 



5 



(45) 



such that 



(46) 



(47) 



I J 



10 



15 



As expressed in scenario constraint (46). in each scenario s, in each time period *, the expected NOl must meet the 
NOl goal Nk. As expressed in scenario constraint (47), in each scenario s, the expected first-year losses must meet 
(not exceed) the loss goal 

J 



As expressed in record/segment constraint (48). the total number of offers given within microsegment i must equal 
the number of accounts in the microsegment. As expressed in record/segment constraint t49), the number of 
inadmissible offers must be zero. 

20 

The objective fimctioo written with scenario probabilities may therefore be expressed as follows: 



r 1 



The objective function (50) may take several forms. It may use some function cr to reflect the tradeoffs 
25 among the scenarios. For example: 
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(51) 



(52) 

s 

cr(fl>,.ft?j,....<»J = min,fi^, 

The expected value approach (SI) is often called Stochastic Linear Programming. Problems with this form 
5 of the objective arc the easiest to solve since they arc linear, but are not always appropriate to a <given problem. 
Such an objective implies risk neutrality on the part of the decision-maker. The utility function approach (52) 
allows the risk tolerance of the decision maker to be modeled explicitly, which is bener for risk averse decision 
making, unless the LCV of the objective function have alieady been adjusted to account for risk. The utility 
function in the objective necessitates nonlinear optimization techniques. Finally, the Maximin formulation of the 
10 objective function (53) finds values for the decision variables that maximize LCV in the worst-case scenario. An 
alternate formulation is to maximize near-terai profit while placing constraints on Expected LCV. The Maximin 
formulation may be appropriate when die decision-maker's risk aversion is strong. By selecting an appropriate 
foimulation, a robust optimization problem may be solved in accordance with a customer*s attitude regarding risk. 

15 Fijgure 13: Optimization of (Customer Relationship Management 

Figure 13 is a flowchart which illustrates optimization of customer relationship matiagement according to 
one embodiment In step 302, a set of customer data corresponding to one or more customers may be collected and 
received. As discussed above, die customer data may include external variables and decision variables. In step 
304. given the set of customer data collected in step 302, one or more decision variables may be optimized based on 

20 an objective and one or more constraints to produce optimized decision variables for a product offer. 'Step 304 may 
further include tiq>utting the set of customer data from step 302 into one or more predictive models to generate one 
or more predictive customer behaviors (i.e., action variables). In one embodiment, the one or more predictive 
models may comprise a neural network. Step 304 is discussed in greater detail with reference to Figures 3 through 
12. 

25 As discussed above with reference to Figure II , in one embodiment, the objective and/or constraints may 

comprise a lifetime customer vahie function. The lifetime customer value function may comprise a stmi of 
expected cash flows over the lifetime of a relationship with the customer. The lifetime -customer value function 
may represent a long-term view and a short-term view of the customer relationship. In one embodiment, a long- 
term view is a period of two or more years. 

30 In one embodiment, optimizing the decision variables may further include optimizing the decision 

variables across a plurality of uncertainty models. As discussed in greater detail with reference to Figures 8 through 
10, in one embodiment, the imcertainty mcxiels may comprise scenarios. The lusceitainty modeb may be generated, 
for example, by varying a set of external variables to represent varying circumstances of possiblefiitures. 
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In one embodiment, the constrauits may include record-level constraints and/or cross-record constraints. 
Cross-record consoraims include limitations on global resources. In one embodiment, the objective may be a cross- 
record objective. Cross-record constraints and objectives are discussed in greater detail with reference to Figure 7. 

In step 306, the one or more terms of a product may be set to the optimized decision variables lo produce 
5 an optimized product. The optimized product may comprise a set of optimized terms. For example, if product is a 
credit card, then the optimized terms may include an optimal interest rate and credit limit. Generally, setting the 
decision variables of the product to the optimized decision variables may result in increasing the value of the 
product vendor's relationships with customers of the product. 

In step 308, the optimized product may be ofTered to one or more of the customers. In various 
10 embodiments, the optimii^cd product may be offered to current and/or prospective customers in a variety of ways 
and under a variety of circumstances. For example, the optimized produce may be offered via a direct mailing, 
targeted advertising, a re-pricing campaign, e-mail, and/or a promotional campaign for customer retention. 

in step 310, a response from the customer to the offering may be accepted. In various embodiments, the 
response may be accepted automatically and without human intervention, such as through an automated on-line or 
1 5 web-based system, or the response may be accepted with human intervention. 

In step 312, the optimized terms may be carried out during a lifetime of the optimized product. In other 
words, the offeror or product vendor may maintain the custonter relationship in step 312 for a particular product 
according to the optimized terms produced in the optimization process of step 304. Carrying out the optimized 
terms may include coiuhicting one or more transactions according to the optimized terms during the product 
20 lifetime. For example, a credit card issuer may honor the interest rate and credit limit of the optimized offer for one 
or more credit-card transactions for as lor^ as the customer holds the credit card. 

Software Architecture for Optimization of Custonier Relationship Management 

Figures 14-2S disclose an architecmre for a software-based optimization and simulation system according 

25 to one embodiment. The software architecture may allow the generation of decisions based on an objective, 
constraints, and uncertainty modcb as discussed with reference to Figures 3 through 13. As discussed above, an 
objective is the target goal of a decision, a constraint is a qualifier for the objective, and an uncertainty model may 
include an expression of uncertainty regarding elements of the objective. In various embodiments, the decisions 
may be made in an off-line, proactive manner wherein many decisions are made all together (■e.g., a batch method), 

30 or in an on-line, reactive maruier wherein one decision is made at a time. The soHwarc architecture may solve the 
integration problems over the entire lifecycle of designing the decisions, making the decisions, and tracking the 
decisions. 

For example, a decision may comprise determining an optimal armual percentage rate (APR) and credit 
line for each customer in a portfolio, wherein that APR and credit line yield the maximum lifetime customer value 
35 (LCV) with a minimum net operating income (for the following year) of $15 million. The objective in this decision 
is to maximize die lifetime customer value. This example optimization problem has one constraint: at least $15 
million in net operating income for the followtx^ year. Furthermore, this example optimization problem has one 
risk factor or clement of uncertainty: the cost of coital has the possibility of varying by ±10% over the next 5 
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years. Many oiher examples could be made wiih respect lo other marketing decisions. manuTacniring decisions, 
production decisions, and other suitable decisions. 

To make such a decision most effectively, a holistic system may be used thai may include designing 
experiments, modeling from the experiments and historical data, making the optunizcd decisions, tracking the 
results from ihc experimcnis'decisions, and embedding the experiments/decisions in on-line applications. One 
method of making the decision is in an off-line manner with a system that will make customer decisions in a batch 
manner. For example, this method might typically be used proactivcly to change the APR and credit line for all 
customers in a portfolio. Another method is in an on-line manner with a system that makes the decision for one 
customer at a time. This manner might typically be used to react to a particular event, such as the -customer calling 
to request a change. The soft%%'are architecmrc disclosed herein comprehends both off-line and on-line methods. 

Figure 14: Off-line System Architecture 

Figure 14 illustrates an off-line system architecmrc for optimization of customer relauonship management 
according to one embodiment In one embodiment, the architecmre not only supports die ability to make off-line 
decisions, but also supports perfonning simulations prior to deploying the off-line and on-line decisions. There are 
four main sections to the architecmre: design of experiments, tracking, model building and decision making. The 
sections may be roughly identified using the modules surrounding the four data stores 2360, 2400, 2530, 2680. The 
design of experiments section includes the Experiment Database 2360 and thie four modules connected to it: Import 
2100, Export 2150. Design Experiment 2300, and Experiment Engine 2340. The tracking section includes the 
Tracking Database 2400 and the Import Module 2100 connected to it. The model-buUding section includes the 
Model Database 2530 and the two modules connected to it: Import 2100 and Build Components 2500. The 
decision-making section includes the Decision Database 2680 and the six modules connected to it: Import 5 100, 
Export 2150, Assemble/Semp Components 2600, Decision Views 2660. Decision Engine 2640. and Decision 
Reports 2670. Various Import 2100 and Export 2150 modules may be coupled to External Data 2200. As shown in 
Figure 14. the off-line system architecmre may inchide Transformations 2120, Component Matheinatical Models 
2510, and Segmentation and Sampling Rules 2330. 

The design of experiments section provides tools for creating and deploying experiments. The purpose of 
the experiments is to test various combinations of decision values (i.e., the values of decision variables) in 
preparation for modeling the results. For example, in a credit card re-pricing problem wherein the decision 
variables concern APR and credit line values for an account, an experiment may test combinations of APR and 
credit line values with current customers and prospective customers. The results may dien be used in the tools 
provided by the tracking and model-biiilding sections of the architecture. 

The model-building section provides tools for creating and deploying madiemaiical models. As discussed 
above, diese models may be built from (e.g., trained on) historical data as well as previous experiments and 
decisions. The mathematical models may encapsulate the data and results in a form that can be used to make funire 
decisions. An example is a mathematical model calculating lifetime customer value of a credit card decision. 'Such 
models may be used in die tools provided by the decision-making section. Results from the modete may also be 
tracked via the tracking section. 
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The decision-making section provides tools for creating and deploying optunized decision answers. For 
example, a pharmaceutical decision might include decision values concerning the number of drug samples and 
client visits. The optimal decision may inchide fmding the right mix of samples and visits for the entire portfolio of 
clients, given budget constraints and risks related to uncenainiy of travel costs. Results from the decisions may be 

5 used in the tracking section. 

The tracking section provides tools for recording the results of the experiments deployed in the design of 
experiment section and the decisions deployed in the decision-making section. The results may then be used in the 
other sections to evaluate the performance of the experiments, models, and decisions. The Tracking Database -2400 
may contain the experiment, model, and decision dau that will be tracked. It may be organized by the projects that 

10 were created in the design of experiments, modcUbuilding, and decision-making sections. The various projects may 
be linked to associate them with one another. Thus, in one embodiment » one is able to know if a model-building 
project relates to a decision-making project and a dcsign-of-experimcnt project Furthermore, a given project might 
be associated with another project. For example, a^iven design-of-experiment project might be derived from 
another design-of-experiment project. Data may be put into the Tracking Database 2400 when a project is 

15 deployed. Deploying a project's experiment via the Expon module 2150 may cause the experiment's data to be 
saved to the Tracking Database 2400. In one embodiment, each section has a sub-module that includes tools that 
use the Tracking Database 2400. 

It is also conceived that these modules can be packaged in many fomis. For example, they could be 
packaged as a desktop software product, as a client-server software product that supports multiple users, or as a web 

20 software product. 

Figiire IS: Import Module 

Figure 15 illustrates the sub-modules of an Impon module 2 100 for optimization of customer relationship 
management according to one embodiment. The Import module 2100 may be used to load data into the various 

25 system databases. The Data Transformation Engine sub-module 21 10 converts the data received from an external 
database or system to a usable form for the various tools using die system databases. Visualizarion Tool sub- 
modules 2140 may cooperate with the Data Transformation Engine sub-module 21 10 to view the data and statistics 
of the data and build the transformations with those views. Example Visualization Tools 2140 are XY plots, row 
number plots, histogram plots, correlation plots, probability plots. PCA plots, and other suitable tools. The 

30 transformations can be built using the views and/or using an editor to explicitly esqsress the transformations in terms 
of the data. In one embodiment, the Import module 2100 is extensible to add and remove Visualization Tool sub- 
modules 2 140. Tbe transformations can be saved in a reusable form 21 20. 

One potential reuse of the OMsformations is m an on-line applk:ation (as shown in Figure 27). wherein the 
transformations 2 120 may be used to automatically transform the data from the on-line application. The application 

35 may use the Data Transformation Engine sub-module 21 10 to transform the application data. The in^ort module 
2100 may also contain Data Interface sub-modules 2130 for interfacing to the various system databases 2360, 2400, 
2530, 2680 and to the various external databases and systems 2200. In one entbodimeni, the Impon module 2 1 00 is 
extensible to add and remove Dau Interface sub-modules 2 1 30. 
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Figure 16: Export Module 

Figure 16 illustrates the sub-modules of an Export module 2 150 for opdmization of custotner relationship 
management according to one embodiment. The Export module 2150 may be used to unload data from the various 
system databases. The Data Transformation Engine sub-module 21 10 converts the data contained io the system 
5 databases lo a usable fonn for the various external systems and databases. The same Data Transformation Engine 
sub-module 2110 may be used for the Export 2150 and Import 2100 modules. The Export modules 2150 contain 
Visualization Tool sub-modules that cooperate with the Data Transfomiation Engine sub-module 21 10 to build the 
iransfonnations. In one embodiment, the Export module 2150 is extensible to add and remove Visualization Tool 
sub-modules. The Visualization Tool sub-modules 2140 used in the Export module 2150 may or may not be the 
10 same as those used in the Import module 2100. In one embodiment, however, all Visualization Tool sub-modules 
2140 support the same interface to be used in either. The transformations built can be saved in a re-usable form 
2120. 

One potential reuse of the transformations is in an on-line application (as shown in Figure 27), wherein the 
transformations 2120 may be used to automatically transform the data from the on-line application. The application 
15 may use the Data Transfomiation Engine sub-module 2110 to transform the data in the Experiment Database 2360. 
The Export module 2150 also contains Data Interface sub-modules 2130 for interfacing to the various system 
databases 2360, 2400. 2530, 2680 and the various external databases and systems 2200. In one embodiment, the 
Export module 2150 is extensible to add and remove Data Interface sub-modules 2130. The Import 2100 and 
Export 2 1 50 modules may share some of the same Data Interlace sub-modules 2 1 30. 

20 

Figure 17: Design Experiment Module 

Figure 1 7- illustrates the sub-modules of the Design Experiment module 2300 for optimization of customer 
relationship management according to one embodiment. The Design Experiment module 2300 may be used to 
create, delete, edit, view, and track the experiments. The Design Experiment module 2300 includes visualization 

25 tools that work with the Experiment Database 2360 and Experiment Engine 2340 to^reate, delete, •edit, and view 
the experiments. The Create Tool sub-inodule 23 10 creates experiments for a project. The. Delete Tool sub-module 
2315 deletes experiments of a project. The Edit Tool sub-modules 2305 manage the segmentation and -sampling 
rules 2330 used by the Experiment Engine 2340. The View Tool sub-modules 2320 include various visualizations 
of the experiments, including reports and charts showing the data after the segmentation and sampling rules arc 

30 applied. The Track Tool sub-modules 2325 include reports and charts comparing the results of executing the 
experiment to what was designed. In one enribodiment, the Design Experiment module 2300 is extensible to add 
and remove Edit Tool 2305, View Tool 2320, and Trade Tool 2325 sub-modules. The Design Experiment modules 
also includes functionality to manage the projects that contain the experiments. 

35 Figure 18: Experiment Engine Module 

Figure 18 illustrates the sub-modules of the Experiment Engine module 2340 for optimization of^ustomcr 
relationship management according to one embodiment The Experiment engine module 2340 may be used to 
apply the segmentation and sampling rules 2330 against the transformed data in the Experiment Database 2360. 
The Segment Engine sub-module 2350 may encapsulate a segmentation algorithm and perform that algorithm 



29 



wo 01/55939 PCr/USOl/02880 
according to the segmentation rules created in the Design Experiment niodule 2300. The segmentation rules may 
be specific to the segmentation algorithm. Segmentation algorithms may comprise simple cut rules to complicaicd 
clustering algorithms. The Sample Engine sub-module 2350 may encapsulate a sampling algorithm and perform 
that algorithm according to the sampling rules created in the Design Experiment module 2300. The sampling rules 
5 may be specific to the sampling algorithm. Sampling algorithms may include a variety of algorithms, from simple 
and random to complicated and score-based algorithms. In one embodiment, the Experiment Engine module 2340 
is extensible to add and remove Segment Engine 23S0 and Sample Engine 2345 sub-modules. 

Figure 19: Build Components Module 

10 Figure 19 illusvatcs the sub-modules of the Build Components module -2500 for optimizaiion of customer 

relationship management according to one embodiment. The Build Components module 2500 may be used to build 
component mathematical models 2510 for use in the decision-making secdon. The component models may be of 
various types, such as neural network, logistic regression, linear regression, genetic algorithm, table lookup, and 
other suitable models. Projects may be created in the Build Conq)onents module 2500 to encapsulate the work for 

1 5 one or more component models. Each type of component model may have its own set of Edit Tools -2505, Analysis 
Tools 2515. and Track Tools 2520. The Edit Tools provide mechanisms for creating and editing component 
instances of the corresponding type of model. For example, an Edit Tool 2505 for a neural network component 
might identify data elements in the Model Database 2530 as inputs and outputs for the neural network and then train 
the neural network on the corresponding data. The Analysis Tools 2515 may provide mechanisms for analyzing 

20 and viewing the conqM>nent models. For exanqile, an Analysis Tool 2515 for a neural network might identify the 
sensitivities of the inputs to outputs. Another Analysis Tool 2515 for a neural network might show the internal 
layers with their corresponding weights. The Track Tools 2520 may provide mechanisms for comparing results 
from deploying the component models. For example, a Track Tool -2520 for a neural network would show 
predicted versus actual values for the outputs, in one embodiment, the Build Components module 2500 is 

25 extensible to add and remove Edit Tool 2505, Analysis Tool 25 15. and Track Tool 2520 sub-modules. 

Figure 20: Assemble/Setup Components Module 

Figure 20 illustrates the sub-modules of the Assemble/Setup Components module 2600 for optimization of 
customer relationship management according to one embodiment. The Assemble/Setup Components module 2600 

30 may be used to perform setup steps required prior to performing the optimization and sirmilation. Projects are 
created in the Assemble/Setup Components module 2600 to encapsulate the configuration work for one or more 
configuration variations. A configuration variation is encapsulated in an abstraction called a question. Questions 
may reference objectives managed by the Assemble Objective 2610 sub-module, risk variables managed by the Edit 
Risk 2615 sub-module, and segments managed by the Edit Segments 2620 sub-module. The Assemble Objective 

35 sub-module 2610 may be used to assemble continent mathematical models 2510 into objectives for a project. 
Assembling may inchide binding component outputs to component inputs. Assembling may also include binding 
conqxment inputs and outputs to data elements in the Decision Database 2690. The project can contain many 
objectives. Questions reference the project's objectives as desired by the user. 
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The Edit Risk sub-module 2615 may be used to create and edit the set of risk variables for a project. Risk 
variables are selected from the set of component inputs, component outputs, and Decision Database -2680 data 
elements. Risk variables may have properties of high and low value. The high and low values arc expressed in 
relation Id the actual value, such as a percentage difference, absolute value, etc. Questions reference the project's 
5 risk variables as desired by the user. The Edit Segments sub-module 2620 may be used to define the segmentation 
to be used for reporting and question solving. The segmentation may be defined according to dimensions, 
attributes, elements; and facts, which are concepts defmed in Multi-Dimensional Databases. In addition, the Data 
Transformation Engine sub-module 2110 may be used in the Edit Segments sub-module -2620 to define 
transformations 2120 thai build facts for the segmentation. These facts fonn the decision-level records to be used 
10 when solving the questions. 

Figure 2 1 : Manage Questions Sub-module 

Figure 21 illustrates a hierarchy of the Manage Questions sub-module 2605 for optimization of 'customer 
relationship management according to one embodiment, in one embodiment, questions may be of two base types: 

15 optimization and prediction. An optimization question solves for a set of input variables in an objective. A 
predictton question calculates an objective. There may also be derivations of these two base types. For example, 
marginal optimization includes an additional objective called the baseline to compare against In one embodiment, 
all questions have basic ftmcuonality provided by die Manage Questions sub-module 2605. This functionality 
includes creating, copying, and deleting questions. The functionality also includes selecting from the project an 

20 objective, the risk variables, and the segmentation element(s) to use for solving the question. The Manage 
Prediction sub-module 2606 adds die functionality of selecting additional objectives. The Manage Optimization 
2607 and Manage Marginal Optimization 2608 sub-modules are discussed below. 

Figure 22: Manage Optimization Sub-module 

25 Figure 22 illustrates the sub-modules of die Manage Optimization sub-module 2607 for optimization of 

customer reladonship management according to one embodiment. The Manage Optimization sub-module 2607 
may add functionality for managing decision variables, constraints, and reason codes to the Manage Questions sub- 
module 2605, The Edit Decision Variable sub-module 2625 may be used to create and edit the set of decision 
variables for a project Decision variables have properties related to dieir values, and die properties are specific to 

30 die type of variable. In one embodiment, two types of decision variables may be used: discrete and continuous. 
Discrete variables have properties describing die possible values. These values can be^xpressed, for exanqjle, as a 
minimum value, maximum value, and increment; or they can be expressed as a set of discrete values. Continuous 
variables have properties of minimum and maximum value. The Manage Optimization sub-module -2607 manages 
die subset of projects decision variables to solve for in a question. The Manage Optimization sub-module -2607 

35 also manages the allowable decision variable value combinations for the question. 

The Edit Constraints sub-module 2630 may be used to create and edit die optimizanon -constraints Tor a 
project. Constraints are expressed usiiig terms diat include data constants, data elements in die Decision Database 
2680, expressions containing data elements, and/or data constants. The constraint expressiwi may include duee 
parts: a left-hand term, a relanonal operamr, and a right-hand tcmL Relational operators are die typical numeric 
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relational opciators such as equaU less than, greater than, etc. Constraints can be global, regional, or local. As 
discussed above, global and regional constraints are constraints where the terms used rolled-up facts from the 
segmentation. For example, a global constraint could be total net operating income over the entire portfolio greater 
than SIS million; and a regional constraint could be total mail costs in the southwest less than SI million. Local 
constraints are constraints where the terms use facts from the decision-level records. For example, a local constraint 
could be number of mailings greater than 0. The Manage Questions sub-module 2605 manages the subset of a 
project *s constraints to use in solving the question. 

The Edit Reasons sub-module 2635 may be used to create and edit the rules for generating reason codes 
associated with the solved decision variables. The rules are expressions that if true, produce a reason code. The 
expressions are built using terms that may include data constants, data clemenu in the Decision Daubase -2680, 
and/or results of calculations on those data elements. The terms may be put together as relational and logical 
expressions. For example, such expressions may include "BehaviorScore < 600" and "CurrentCL > NewCL**. 

Figure 23: Manage Marginal Optimization Sub-module 

Figure 23 illustrates the sub-modules of the Manage Marginal Optimization sub-module 2608 for 
optimization of customer relationship management according to one embodiment. The Manage Marginal 
Optimization sub-module 2608 may add the functionality of managing a baseline objective to the Manage 
Optimization sub-module 2608. The Manage Baseline sub-module 2636 identiftes the objective from the project's 
list of objectives and initiates the calculation of dw baseline objective for the decision records. A baseline objective 
is of the same structure as the optimization objective, except the behavioral components of the objectivo represent 
the normal business behavior. For example, if the optimization objective is lifetime customer value, the baseline 
objective is also lifetime customer value. And, the difference between the two is the set of«components assembled 
into each. 

Figure 24: Decision Engine Module 

Figure 24 illustrates the sub-modules of the Decision Engine module -2640 Tor optimization of customer 
relationship management according to one embodiment The Decision Engine module 2640 may be used to 
perfomi the calculations for a question. The Calculation Engine sub-module 2645 may be used to calculate the 
objective, constraints, and any miscellaneous equations for a decision level record. The objective, xonstraints, and 
miscellaneous equations may be created in the Assemble/Setup Components module ^600 by assembling 
components. A decision-level record is cither formed via the segmentation transformations in die Edit "Segments 
sub-module 2635 or assumes the account-level records brought into the Decision Database ^2680. An account-level 
record lepresents the data elements for a customer or some entity that is the focus of the decision. 

The Decision Engine module 2640 may be configured with multiple Olculation Engine sub-modules 2645 
depending on the configuration of the Question Engine sub-module 2650. The Question Engine sub-module 2650 
performs the algorithm specific to. a question. If the question is configured to perform an optunization, the Question 
&iguie 2650 may inchide that optimization algorithm. If the question is configured to perform a prediction, the 
Question Engine 2650 may include diat prediction algorithm. For exan^le, if the question is configured to perform 
an optimization of discrete decision variables with global constraints and risk variables, then a Question Engine 
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2650 with lhai ability is used. In one embodiment, the Decision Engine module 2640 is extensible to add and 
remove Question Engine sub-modulcs 2650. It is also conceived die Decision Engine module 2640 could be built 
to nm calculations in paraUel or in a distributed manner. For example, die Quesiioo Engine sub-module 2650 could 
invoke multiple Calculation Engine sub-modules 2645 in parallel or across a network (in a distributed manner). 

5 

Figure 25: Decision Views Module 

Figure 25 illustrates the sub-modules of the Decision Views module 2660 for optimization of customer 
relationship management according to one embodiment The Decision Views module 2660 may be used to perform 
minor setup changes to a question, to start die calculations, and to view die results of die calculations. Minor scnip 

10 changes include selecting the segment over which the calculations are run and selecting die risk variables. Access 
may also be provided to die setup fiinctionaliiy in die Assemble/Setup Components module 2600, which allows 
more major changes. Once die setup changes have been made, a mechanism is provided to start die calculations, 
which will be run by die Decision Engine module 2640, After die calculations have been run, various tables and 
charts are used to evaluate die decisions. The tobies and charts arc encapsulated via a View sub-module ^665. In 

15 one embodiment, die tables and charts have direct access to die results of die Decision Engine -2640, including 
details diat might not be stored persistently in die Decision Database 2680. The View sub-modules 2665 may allow 
one to compare die scenario simulations generated from die risk variables and look at die robusmess of die 
decisions across diose scenarios. Access may also be provided to the reports 2675 in die Decision Repons modules 
2670. In one embodiment, die Decision Views module 2660 is extensible to add and remove View sub-modules 

20 2665. 

Figure 26: Decision Reports Module 

Figure 26 illustrates die sub-modules of die Decision Reports module 2670 for optimization of customer 
relationship management according to one embodiment. The Decision Reports module 2670 may be used to 

25 examine die results of a project*s question from the Decision Database 26g0. The results may be shown as reports 
via Report sub-modules 2675. These reports may take many forms, including web pages. In one embodiment, all 
reports may show die results widiin die segmentation. The results shown may include die decision mix. die 
constraint adherence, die objective values, intermediate calculations, and question configuration infomiarion. There 
may also be provided comparison reports diat compare any of die results between projects and between questions. 

30 There may also be provided tracking reports showing the acmal resuks versus die predicted xesiilts. The tracking 
reports work off the Tmcking Database 2400. In one embodiment, die Decision Reports module 2670 is extensible 
to add and remove Repoit sub-modules 2675. 

Figures 27 and 28: On-Line Architecture 
35 In one embodiment, die system architechire for on-line, reactive decisions may be a modification of die 

off-line system architccmre. On-line applications arc usually buih to serve odicr purposes dian makii^ decisimis. 
Tbeicforc, die process of making a decision needs to be embedded in dwse on-line appUcations. Figure 27 shows 
die system architecmre for embedding die experiment process according to one embodiment. Figure 28 shows die 
system architecnxre for embedding die decision process according to one embodiment. To embed die experiment 
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and decision processes, the applicarion programming interfaces (APIs) for the Data Transformation Engine sub- 
module 2110, the Experiment Engine module 2340, and the Decision Engine module 2640 may be provided to the 
programmer of the on-line application. 

Figure 27 illustrates an on-line experiment architecture for optimization of customer relationship 
5 management according to one embodiment. To embed the experiment process, the on-line application may be 
modified to use the APk for the Data Transformation Engine sub-module 2 1 10 and the Experiment Engine module 
2340. The transformations 2120 and rules 2330 are built with the modules of the off-line system architecture (see 
Figure 14). Once built and tested via simulations, they may be deployed to the on-line application. The Experiment 
Database 2360 may be implemented as an in-memory database. In one embodiment, it is only required to hold the 

1 0 data elements for one customer or entity. 

Figure 28 illustrates an on-line decision architecmre for optimization of customer relationship management 
according to one embodimcni. To embed the decision process, the on-line application may be modified to use the 
APIs for the Data Transformation Engine sub-module 2110 and the Decision Engine module 2640. The 
transformations 2120 and component models 2510 arc built with the modules of the off-line system architecture 

IS (see Figure 14), Once built and tested via simulations, they may be deployed to the on-line application. If the 
decision does not include global or regional constraints, the Decision Database 2680 may be implemented as an in- 
memory database, since it is only required to hold the data elements for one customer or entity. However, with 
global or regional constraints, the Decision Daubase 2680 holds the data elements for all customers or entities to 
which the constraints apply. 

20 Various embodiments may further include receiving or storing instructions and/or data implemented in 

accordance witfi the foregoing description upon a carrier medium. Suitable carrier media may include storage 
media or memory media such as magnetic or optical media, e.g., disk or CD-ROM, as well as signals such as 
electrical, electromagnetic, or digital signals, conveyed via a conununicaiion medium such as networks 102 and/or 
1 04 and/or a wireless link. 

25 Although the system and method of the present invention have been described in connection with several 

embodimeiiU, the invention is not intended to be limited to the specific forms set forth herein, but on the contrary, it 
is intended to cover such alternatives, modifications, and equivalents as can be reasonably included within the spirit 
and scope of the invention as defmed by the appended claims. 
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1. A method for selecting an optimal course of action for marketing products to a plurality of 
customers, the method comprising: 

inputting customer data records into one or more predictive models lo^enerate one or more action 
variables, wherein the action variables comprise predictive customer behaviors 
corresponding to the customer data records; 

inputting an objective function and one or more constraints into an optimizer, wherein the 
constraints comprise limitations on one or more resoiurces, and wherein the objective 
function and the constraints comprise a function of the action variables across a pluralit>' 
of uncertainty models; 

the optimizer solving the objective function subject to the consnraints to select an optimal course 
of action across the plurality of uncertainty models for marketing products to a pluralitx- 
of customers. 

2. The method of any of the preceding claims, further <:omprising: 

a user selecting the uncertainty models according to managerial judgment. 

3. The method of claim 2. 

wherein the user selecting the uncertainty models according to managerial judgment further 
comprises the user selecting a prior distribution. 

4. The method of any of the preceding claims, further comprising: 

generating the plurality of uncertainty models by sampling a probability distribution to represent 
varying circinnstances of possible futures. 

5. The method of any of the preceding claims, 
wherein the uncertainty models comprise scenarios. 

6. The method ofclaimS, further comprising: 

assigning a weight to each of the scenarios to denote its likelihood of occurrence. 

7. The method of any of the preceding claims, 

wherein the uncenainty models arc implemented by a neural network. 

8. The method of any of the preceding claims, 

wherein the uncertainty models comprise one or more averaged models and a residual model. 
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9. 



The method of claim 8» further comprising: 

training a neural network to represent the averaged models. 
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10. The method ofanyofihe preceding claims. 

5 wherein solving the objective function subject to the constraints to select the optimal course of 

action across the plurality of uncertainty models further comprises solving the objective 
function to avoid a worst case scenario. 

1 1 . The method of any of the preceding claims, 

10 wherein solving the objective function subject to the constraints to select the optimal course of 

action across the plurality of uncertainty models further comprises solving the objective 
function according to a desired level of risk. 

1 2. The method of any of the preceding claims, further comprising: 

15 marketing the products to the plurality of customers in accordance with the optimal course of 

action. . 

1 3 . The method of any of the preceding claims, further comprising: 

applying the optimal course of action to one or more customer relationships to increase the value 
20 of the customer relationships. 

14. The method of any of the preceding claims, 

wherein each customer data record corresponds to an individual customer. 

25 15. Themethodof any of the preceding claims. 

wherein each customer data record corresponds to a segment, wherein the segment comprises a 
plurality of customers. 

1 6. The method of any of the preceding claims, 

30 wherein each customer data record corresponds to a sanqile of a plurality of customers. 

17. The method ofany of the preceding claims, 

wherein the predictive models comprise a neural network. 

35 18. The method of any of the preceding claims, further comprising: 

naining the neural network as a function of historical data records. 
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19. The method of any of the preceding claims, 

wherein the optimizer solving the objective function further comprises solving the objective 
function via linear programming. 

5 20. The method of any of the preceding claims, 

wherein the optimizer solving the objective function further comprises solving the objective 
function via non-linear programming. 

2 1 . The method of any of the preceding claims, 

1 0 wherein the objective function is a cross-record objective' function. 

22. The method of any of the precedmg claims, further comprising: 

inputting one or more cross-record constraints into the optimizer, wherein the cross-record 
constraints comprise limitations on one or more global resources; 
IS and wherein the optimizer solving the objective funcrion further connprises the optimizer solving 

the objective function subject to the cross-record constraints. 

23. The method of any of the preceding claims, 

wherein the objective function further comprises a function of lifetime -customer value. 

20 

24. The method of claim 23, 

wherein lifetime customer value comprises a sum of discounted cash flows over the lifetime of a 
customer relationship. 

25 25. A system comprising: 

one or more predictive models operable to generate one or more action variables from a plurality 
of customer data records, wherein the action variables comprise predictive customer 
behaviors corresponding to the customer data records; and 
an optimizer coupled to the predictive models, wherein the optimizer is operable to receive an 
30 objective function aiul one or more constraints, wherein the constraints comprise 

limitations on one or more resources, wherein the objective function and die constraints 
comprise a function of the action variables across a plurality of uncertainty models, and 
wherein the optimizer is f^>crable to solve the objective function subject to the 
constraints to select an optimal course of action across the plurality of unccnatnty 
35 models for marketing products to a plurality of customers; 

wherein the system is operable to perform the method of any of claims 1 through 24. 

26. A carrier medium corr^nising program instructions which axe computer-executable to implement 
the method of any of claims 1 through 24. 
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27. A method comprising: 

inputting data records into one or more prediccive models to -generate one or more action 
variables; 

inpuning an objective function and one or more constraints into an optimizer, wherein the 
constraints comprise limitations on one or more resources, and wherein the objective 
function and the constrainu comprise a function oF the action variables across a plurality 
of uncertainty models; 

the optimizer solving the objective function subject to the constraints to select an optimal course 
of action across the plurality of uncertainty models. 

28. A method for determining an optimal course of action for marketing one or more products to a 
plurality of customers, the method comprising: 

inputting customer data records into one or more predictive models to generate one or more action 
variables, wherein the action variables comprise predictive -customer behaviors 
corresponding to the customer data records; 

inputting an objective function and one or more constraints into the optimizer, wherein the 
objective function comprises a function of the action variables, wherein the constraints 
comprise limitations on one or more resources, and wherein the objective function 
further comprises a function of lifetime customer value; 

die optimizer solving the objective function subject to (he constraints to select an optimal course 
of action for marketing one or more products to a plurality of customers. 

29. A method for selecting an optimal course of action for marketing one or more products to a 
plurality of customers, the method comprising: 

inputting customer data records into one or more predictive models to generate one or more action 

variables, wherein the action variables comprise predictive customer behaviors 

corresponding to the customer data records; 
inputting an objective function and one or more constraints into an optimizer, wherein the 

objective function comprises a function of the action variables, and wherein the 

constraints comprise limitations on one or more resources; 
the optimizer solving the objective function siibject to limitations on one or more global resources 

to select an optimal course of action for marketing one or more producu to a plurality of 

customers. 

30. A method for managing customer relationships, the method comprising: 
collecting a set of customer data corresponding to one or more customers; 

optiinizing one or more decision variables based on an objective and one or more constraints for 
the set of customer data to produce optimized decision variables for a product offer. 
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sening one or more icrms of a product lo the optimized decision variables to produce an 

optimized product, wherein the optimized product comprises a set of optimized terms; 
offering the optimized product to one or more of the •customers; 
accepting a response from the customer to the ofTering; 
. carrying out the optimized terms during a lifetime of the optimized product. 
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